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A  first-order  methodology  for  calculating  the  probability  that  a  system  will 
successfully  complete  its  mission  was  developed,  illustrated,  and  validated. 
The  methodology  is  directed  to  analysts,  designers,  managers,  physicists, 
and  planners  who  are  unaccustomed  to  working  with  statistics  and  probability 
theory,  but  who  are  assumed  to  have  had  an  introductory  course  in  statistics 
and  probability  theory.  The  methodology,  which  makes  use  of  closed-form 
solutions  and  is  quite  transparent,  is  designed  to  yield  results  quickly  and 
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and  without  the  use  of  a  large  computer.  It  is  not  intended  to  replace  the 
formal,  more  accurate  computerized  methodologies  that  use  Monte  Carlo  simu¬ 
lations  or  numerical  partitioning.  Within  its  specified  applicable  domain, 
the  methodology  yields  quantitatively  accurate  results.  The  applicable  domain 
is  sufficiently  large  to  encompass  many  problems  of  interest  to  the  Defense 
Nuclear  Agency  community. 
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SUMMARY 


An  analytical  methodology  is  presented  for  calculating,  to  the  first  order, 
the  probability  that  a  system  will  successfully  complete  its  mission.  The  methodology, 
which  is  quite  transparent,  is  designed  to  yield  results  quickly  and  without  the  use  of 
a  large  computer.  It  is  not  intended  to  replace  the  formal,  more  accurate  computerized 
methodologies  that  use  Monte  Carlo  simulation  or  numerical  partitioning. 

The  probability  of  mission  success  is  calculated  by  collapsing  a  network  of 
probabilities.  Each  network  probability  represents  the  probability  of  no  failure  of  the 
system  in  a  failure  mode  that,  either  by  itself  or  in  concert  with  other  failure  modes, 
would  abort  the  mission.  The  fact  that  there  is  a  probability  of  failure  of  the  system  in 
a  given  failure  mode  reflects  the  uncertainty  embodied  in  the  system's  capacity,  or  in  the 
demand  placed  on  the  system,  or  both.  Systematic  and  random  uncertainties  are  differen¬ 
tiated.  The  systematic  uncertainties  are  associated  with  the  estimates  of  the  capacity 
and  demand  means,  which  are  treated  as  random  variables.  The  systematic  uncertainties  are 
ultimately  reflected  as  variability  in  the  calculated  probability  of  mission  success. 

The  system  failure  modes  that  would  abort  the  mission  are  grouped  into  sets 
such  that  within  each  set  it  can  be  reasonably  assumed  that  there  is  perfect  dependency; 
between  sets,  it  can  be  reasonably  assumed  that  there  is  statistical  independency.  Each 
such  set  represents  one  probability  in  the  system's  probabi 1 i ty-of-mi ssion-success  network. 
Arbitrary  correlation,  reflecting  the  systematic  uncertainty  in  the  estimates  of  capacity 
and  demand  means,  is  admitted  between  any  two  probabilities  in  the  network. 

The  density  distributions  for  capacities,  capacity  means,  demands,  and  demand 
means  are  assumed  to  be  lognormal.  The  effect  of  this  assumption  and  of  other  approxi¬ 
mations  inherent  in  the  methodology  are  demonstrated  by  working  illustrative  problems 
with  both  the  presented  methodology  and  Monte  Carlo  simulation.  The  applicable  domain 
of  the  methodology  hereby  established  is  sufficiently  large  to  encompass  many  problems 
of  interest  to  analysts,  designers,  managers,  physicists,  and  planners  in  the  Defense 
Nuclear  Agency  community. 

The  presented  methodology  (or  tor  that  matter  any  methodology  of  the  same 
purpose)  requires  that  systematic  uncertainties  be  quantified  using  subjective 
reasoning.  If  a  sponsor  will  not  accept  subjective  estimates,  then  there  can  be  no 
application  of  the  methodology.  Most  sponsors,  however,  will  entertain  the  idea  of  sub¬ 
jective  estimates  if  the  bases  for  these  estimates  are  well  documented. 


PREFACE 


The  writers  wish  to  thank  A.H-S.  Ang,  Professor  of  Civil  Engineering, 
University  of  Illinois,  for  his  critical  review  of  Appendixes  A  and  B  and  for  his 
constructive  suggestions  for  improving  the  presentations.  Finally,  the  valuable  guid¬ 
ance  and  suggestions  provided  by  CPT  M.  Moore,  the  Contracting  Officer's  representative, 
during  the  conduct  of  this  project  are  gratefully  acknowledged. 


2 


TABLE  OF  CONTENTS 


Section  Page 

1  .INTRODUCTION . 5 

1-1  PURPOSE . 5 

1-2  APPLICABILITY  .  . . 5 

1-3  BACKGROUND - - - . .  5 

1- 4  ORGANIZATION . - . . .  6 

2  CAPACITY  AND  DEMAND . . - .  7 

2- 1  INTRODUCTION - - -  7 

2-2  METHODOLOGY - 7 

2-3  ILLUSTRATIVE  USE -  10 

2- 4  VALIDATION - 12 

3  CAPACITY  WILL  EXCEED  DEMAND . 14 

3- 1  INTRODUCTION - 14 

3-2  METHODOLOGY . 15 

3-3  ILLUSTRATIVE  USE . 17 

3- 4  VALIDATION . 19 

4  CAPACITY  WILL  EXCEED  REPEATED  DEMANDS  .  25 

4- 1  INTRODUCTION .  25 

4-2  METHODOLOGY .  26 

4-3  ILLUSTRATIVE  USE . 27 

4-4  VALIDATION - - - .  28 

5  FAILURE-MODE  SETS - 33 

6  ASSESSMENT - - - -  35 

6-1  INTRODUCTION  . . . ------- . .  35 

6-2  METHODOLOGY . . 35 

6-3  ILLUSTRATIVE  USE - - -  38 

6- 4  VALIDATION . . . - .  40 

7  ALLOCATION - 44 

7- 1  INTRODUCTION . . .  44 

7-2  METHODOLOGY . . - .  44 

7-3  ILLUSTRATIVE  USE - 46 

8  CLOSING  REMARKS . .  49 

9  REFERENCES - - - .  50 

Append i x 

A  DERIVATION  OF  EQUATIONS  3-2  AND  3'5 . 51 

B  DERIVATION  OF  EQUATIONS  3-6  AND  3'7 .  59 

3 


LIST  OF  ILLUSTRATIONS 


Fi gu re 
2-1 
3-1 
3-2 
3-3 

3- 4 

4- 1 

4-2 

6-1 

6-2 


Table 

3- 1 

4- 1 

5- 1 


Page 


Aid  in  assigning  A-  ------------------------  1 3 

Xj 

Expected  probability  that  capacity  will  exceed  demand  —  small  COV's  -  21 

Systematic  COV  of  P(C  >0)---------------------  22 

Plot  of  Equation  3~8a  for  P  =  0.9  -----------------  23 

Illustrative  problem  ------------------------  24 

Probability  that  capacity  will  exceed  repeated  demands:  One  failure 

mode  --------------------------------  30 

Illustrative  problem  ------------------------  32 

Probability  of-Mi ssion-Success  envelope  ---------------  42 

Illustrative  problem  ------------------------  43 


LIST  OF  TABLES 


Page 


Tabulated  cumulative  probability  of  the  normal  distribution  -----  20 

Probability  that  capacity  will  exceed  N  demands:  One  failure  mode  29 

Probability  that  capacity  will  exceed  demand  for  each  of  M  failure 
modes:  One  application  of  the  demands  ---------------  34 


SECTION  1 


INTRODUCTION 


1-1  PURPOSE. 

The  purpose  of  this  document  is  to  present  a  first-order  methodology  for  calcu¬ 
lating  the  probability  that  a  system  will  successfully  complete  its  mission,  to  illustrate 
the  methodology,  and  to  validate  the  methodology. 

1-2  APPLICABILITY. 

The  methodology  is  directed  to  analysts,  designers,  managers,  physicists,  and 
planners  who  are  unaccustomed  to  working  with  statistics  and  probability  theory.  The  users 
however,  are  assumed  to  have  had  an  introductory  course  in  statistics  and  probability 
theory.  The  methodology,  which  makes  use  of  closed-form  solutions  and  is  quite  transparent 
is  designed  to  yield  results  quickly  and  without  the  use  of  a  large  computer.  It  is  not 
intended  to  replace  the  formal,  more  accurate  computerized  methodologies  that  use  Monte 
Carlo  simulation  or  numerical  partitioning. 

Within  its  specified  applicable  domain,  the  methodology  yields  quantitatively 
accurate  results.  Outside  its  domain,  it  yields  qualitatively  accurate  results.  The 
applicable  domain  is  sufficiently  large  to  encompass  many  problems  of  interest  to  the 
Defense  Nuclear  Agency  community. 

1-3  BACKGROUND. 

Either  an  explicit  or  an  implicit  probabi 1 i ty-of-mi ss ion-success  criterion  is 
imposed  on  the  designing  of  a  system,  be  it  civil  or  military,  small  or  large,  simple  or 
complex.  Each  mission  of  the  system  would  have  its  own  criterion.  A  typical  explicit 
criterion  would  read: 

The  lower  one-sided  Q-confidence  limit  for  the  probability  that  the  system 

will  successfully  complete  Mission  X  shall  be  at  least  PMSo. 

Implicit  criteria,  by  contrast,  make  use  of  such  terms  as  "factor  of  safety,"  "margin  of 
safety,"  and  "reserve  capacity."  Implicit  criteria,  which  call  for  deterministic  method¬ 
ology,  are  not  addressed  here. 
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The  probability  of  mission  success  is  calculated  by  collapsing  a  series- 
parallel  network  of  probabilities.  Each  network  probability  represents  the  probability 
of  no  failure  of  the  system  in  a  failure  mode  that,  either  by  itself  or  in  concert  with 
other  failure  modes,  would  abort  the  mission.  The  fact  that  there  is  a  probability  of 
failure  of  the  system  in  a  given  failure  mode  reflects  the  uncertainty  embodied  in  the 
system's  capacity,  or  in  the  demand  placed  upon  the  system,  or  both.  In  general,  both 
random  and  systematic  uncertainties  are  present.  Random  uncertainty  cannot  effectively 
be  reduced  by  gathering  more  data  or  by  conducting  research  and  development.  Systematic 
uncertainty,  however,  can  be  reduced  by  gathering  more  data  or  by  conducting  research  and 
development,  since  it  reflects  parameter  estimation  and  modeling  errors;  i.e.,  it  reflects 
our  ignorance.  The  presence  of  systematic  uncertainty  prevents  us  from  calculating  the 
probability  of  mission  success  with  100%  confidence. 

Refer  to  Reference  6  for  additional  background. 

1-4  ORGANIZATION. 

This  report  is  organized  into  nine  sections  and  two  appendixes.  Section  2 
explains  how  to  calculate  the  mean,  the  random  coefficient  of  variation,  and  the  syste¬ 
matic  coefficient  of  variation  of  the  system's  capacity  in  a  given  failure  mode  and  of  the 
demand  placed  on  the  system.  Section  3  explains  how  to  calculate  the  probability  that 
a  capacity  will  exceed  a  single  application  of  a  demand.  The  methodology  presented  in 
Section  3  is  extended  in  Section  4  to  the  problem  of  repeated  applications  of  demand. 
Section  5  concludes  that  the  methodology  presented  in  Section  4  is,  with  a  change  of 
notation,  also  applicable  to  a  set  of  failure  modes.  Section  6  explains  how  to  use  the 
methodology  presented  in  Sections  2  through  5  to  assess  the  probability  of  mission 
success  of  an  existing  system.  Section  7  explains  how  the  reverse  concept  of  assess¬ 
ment,  the  allocation  of  the  probability  of  mission  success  to  an  evolving  system,  is 
accomplished.  Finally,  closing  remarks  are  made  in  Section  8.  References  are  given  in 
Section  9.  Key  derivations  are  given  Appendixes  A  and  B. 

With  the  exception  of  Sections  5,  8,  and  9,  each  section  is  organized  into 
four  subsections:  introduction  of  the  subject,  methodology,  example  problems  solved  by 
the  methodology,  and  validation  of  the  methodology  by  re-solving  the  example  problem  with 
Monte  Carlo  simulation. 
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SECTION  2 


CAPACITY  AND  DEMAND 


2-1  INTRODUCTION. 

A  system  responding  in  a  given  failure  mode  is  characterized  by  its  current 
capacity  to  resist  failure  and  by  the  demand  placed  on  the  system.  In  general,  both  the 
capacity  and  the  demand  will  be  random  variables.  For  our  purposes,  three  descriptors  are 
sufficient  to  describe  the  capacity  or  the  demand:  (1)  its  mean  (expected,  or  average) 

J. 

value;  (2)  its  random  coefficient  of  variation  (CO V)  ;  and  (3)  its  systematic  COV.  Use 
the  equations  given  below  to  calculate  these  three  descriptors  for  the  capacity.  Change 
the  notations  used  in  these  equations  and  use  them  to  calculate  the  three  descriptors  for 
the  demand. 


2-2  METHODOLOGY. 

First,  either  implicitly  or  explicitly  state  capacity  C  symbolically  in  terms 
of  its  (functionally)  independent  variables: 


C  =  f (xj ... .Xj ..Xj) 


(2-1) 


The  first-order  approximation  of  the  mean  of  C  is  simply 


(2-2) 


where  uXj  is  the  mean  of  x.y  Equation  2-2  is  quite  accurate,  provided  that  the 

nonlinearity  in  f(-)  with  respect  to  X;,  near  pv  ,  is  not  severe  and  that  the 

J  j 

variability  of  x^  is  not  large.  If  required,  the  accuracy  of  Equation  2-2  can  be 
increased  by  adding  the  second-orde'-  term: 


2  ?2f  A2 

x  .  „  2  x . 

j  3Xj  j 


+ 


J  J 

o-5  E  E 


i=i  j=i 

i*j 


Vj 


3X.  3x. 
I  I 


P  .  .  A 
ij  x 


6 

X  . 

J 


(2-3) 


The  standard  deviation  divided  by  the  mean. 

See,  for  example,  Reference  1  for  the  derivation  of  Equations  2-2,  2-3,  and  2-*t. 
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2  2 

where  3  f/3x.  is  to  be  evaluated  at 
J 

and  p  .j  is  the  correlation  coefficient  for  x. 
of  C  is  simply 


xj »  liX2  ’  ^xj’ '  ’  '  ’  '  x  ; 

and  x 


i  s  the  COV  of  x. ; 

J  J 

The  square  of  the  COV 


1 


3f  Of 


Ox. 


p  .  .  6  6 

Ox.  II  X.  X. 

J  J  I  J 


(2-4) 


Equation  2-4  is  quite  accurate  for  5 


1.  (lotice  that  the  estimates  of 


and 


are  dependent  only  on  the  means  and  COVs  of  the  probability  density  distributions  of 
the  independent  variables;  distribution  details  enter  into  the  higher-order  terms,  which 
are  not  used  here. 


Invariably,  your  values  for  the  mean  and  COV  of  x^.  will  be  only  esti¬ 
mates.  In  general,  the  error  in  your  estimates  of  6  ,  the  actual  COV  of  x., 


'j 


J 

the 

but 


will  not  be  of  consequence  relative  to  the  error  in  your  estimate  of 

actual  mean  of  x_  Therefore,  neglect  the  error  in  your  estimate  of  <5X  , 

a  count  for  your  error  in  estimating  mv  by  assuming  that  x.,  your  best  esti- 

*J  J 

mate  of  ,  is  itself  a  random  variable  with  actual  mean  |,y .  and  actual  COV 

Xj  *j 

-  •  Denote  Sx.  as  the  random  COV  of  x.,  and  Ax.  as  the  systematic  COV  of 
-  j  J  J  J 

x..  In  a  similar  fashion,  account  for  the  random  and  systematic  uncertainty  in  your 
J  .U 

functional  form  of  C  (Eq.  2-1).  Equations  2-2,  2~3,  and  2-4  now  become 


f  (x, 


.  .x . x  ) 

J  J 


(2-2a) 


=  f (x, , . . 


X  .  ,  . 

J 


..ij) 


+  0.5 


J  9 

L  x 

j=!  J 


,2f  ,  J  J 

+  0.5  £  £ 
■x  j  i=1  j=1 


-  -  ‘f  r  t 

x .  x  .  - - —  p  .  .  0  A 

I  J  Jx .  .IX  .  II  X.  X. 

I  j  I  J 


(2-3a) 


This  concept  for  accounting  for  your  error  in  estimating  and  ux  comes  from 

Ang  (see, for  example,  Ref. 2).  However,  in  what  follows,  we  depart  from  Ang's 
method  of  application  of  this  concept. 
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2 


2 


(2-l»a) 


3f 

Jx. 

i 


3f  t  r 

- -  p  .  .  o  iS 

Jx.  IJ  X.  X. 

J  '  J 


where  0i  is  your  best  estimate  of  the  COV  that  reflects  the  random  variability  in 
the  functional  form  of  C  for  given  values  of  x^  ,  and  the  remaining  symbols,  con 
ventions,  and  restrictions  are  as  previously  defined.  Use  Equation  2-2a  or  2-3a  to 
calculate  the  mean  of  C,  and  Equation  2-ha  to  calculate  the  random  COV  of  C. 


Use  the  following  approximate  expression  to  calculate  the  square  of  the 
systematic  COV  of  C: 


J  J 

£  E 

i=i  j=i 

i*j 


X  .  X 


Jf. 

■>X 


,-rrA-  A- 

IJ  X.  X . 

I  J 


(2-5) 


where  ,\j .  is  the  COV  you  associate  with  how  well  x^  represents  wx j • 
COV  you  associate  with  the  modeling  error  in  your  functional  form  of  C; 
the  correlation  coefficient  for  x.  and  x^ ;  and  the  remaining  symbols, 
tions,  and  restrictions  are  as  previously  defined.  Notice  the  similarity 
Equations  2 -4a  and  2-5. 


A-  is  the 

"7J  is 

conven- 

between 


Determi ne  x  . 


,s 


and 


from  appropriate  statistical  data. 


J’  -j'  f’ 

Choose  A-  by  quantifying  your  "degrees  of  belief"  about  how  well  x. 

xj  *  J 


the  actual  mean  of 


x .  . 
J 


represents 

(Similarly  for  Aj.)  Use  the  information  provided 


in  Figure  2-1  to  help  quantify  your  degrees  of  belief.  Use  judgment  to  assign 


values  for  pv-, 
i  ) 


the  correlation  coefficient  for  x.  and 


x . . 
J 


It  should  not  be  overlooked  that  a  large,  deterministic  computer  code  can 
be  used  to  calculate  means  and  COVs  with  the  above  methodology.  The  code  itself 
would  be  used  to  calculate  the  first-order  estimate  of  the  mean  and  the  partial 
derivatives  appearing  in  the  equations  for  the  COVs.  The  stringing  together  of  these 
partials  for  the  actual  calculation  of  the  COVs  and  the  second-order  estimate  of 
the  mean  would  be  done  outside  the  code. 


If  experiments  have  been  performed,  use  A_ 
exper i men  t  s  .  j 


where  n 


is  the  number  of 
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2-3 


ILLUSTRATIVE  USE. 


where 


mean  of 


Calculate  the  mean,  the  random  COV,  and  the  systematic  COV  of  the  capacity 


C  =  x2  exp(0.50y) 


X 

= 

1.00 

y 

= 

0.50 

6 

X 

= 

0.17 

6 

s 

0.23 

y 

6f 

= 

0. 10 

A- 

_ 

0.03 

X 

A- 

= 

0. 1 1 

y 

Af 

= 

0.15 

Pxy 

= 

Pyx  = 

0.50 

Pxy 

= 

pyx  " 

0.00 

First,  calculate  C,  6^., 
C. 


and  A-  using  Equation  2-2a  to  estimate  the 


Equation  2-2a. 

C  =  x2  exp(0.50y) 

=  1.234 


Equation  2-4a. 


62  =  62  +  462  +  0.25y262  +  yp 


5  5  +  yp  6  5 

xy  x  y  yx  x  y 


=  0.385 
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of  C . 


Equation  2-5. 


2  2  2  2  2 
A*  =  Ar  +  4A-  +  0.259  A-  +  9P--A-A-  +  9P--A-A- 
C  f  x  y  xyxy  '  yx  x  y 


=  0- 164" 


Now,  calculate  C,  6^.,  and  A-  using  Equation  2-3a  to  estimate  the  mean 


Equation  2~3a. 


C  =  x2  exp (0.509)  1  +  62  +  0.1259262  +  0.5p  6  6  +  0.5p  6  6 

x  y  xy  x  y  yx  x  y 


=  1 .234  x  1 .05 


=  1.348 


Equation  2-4a. 


•d  .  .  O.J672 

1.05 


Equation  2~5. 


,2  0.164 

Ac  =  — r 

L  1.05 


0.156' 


Since  the  second-order  terms  are  only  5?>  of  the  first-order  term,  we  can  conclude  that 
the  estimates  of  C,  6^.,  and  A^  are,  as  will  be  seen  below,  relatively  accurate  and 
relatively  insensitive  to  the  assumed  distributions  of  x,  y,  f,  x,  y,  and  f. 


2-4 


VALIDATION 


In  order  to  validate  the  methodology  presented  in  this  document,  we  have  used 
the  Monte  Carlo  simulation  technique  to  rework  the  illustrative  problems.  In  this  tech¬ 
nique,  pseudorandom  variates  are  generated  on  a  computer  to  form  artificial  samples.  We 
used  the  Marsag 1 ia-Bray  method  (Ref.  3)  on  a  Data  General  Eclipse  S/130  computer  to 
generate  pseudorandom  normal  and  lognormal  deviates.  Cycling  of  the  deviates  was 
required  for  some  of  the  problems  because  of  inadequate  word  length  on  the  computer. 

In  our  simulations  for  the  illustrative  problem  presented  in  Section  2-3, 
an  outer  loop  of  size  1000  controlled  the  generation  of  the  systematic  deviates.  For 
each  set  of  systematic  deviates,  an  inner  loop  of  1000  sets  of  random  deviates  was 
collected.  In  our  first  simulation,  all  distribution  models  (x,  y,  f,  x,  y,  f)  were 
assumed  normal.  The  results  were  C  =  1.339.  =  0.378,  and  A^  =  0.152.  Our  method¬ 
ology,  which  makes  no  assumption  as  to  distribution,  yielded  C  =  1.348,  6^.  =  0.367, 

and  A-  =  0.156.  The  agreement  is  seen  to  be  quite  good. 

In  our  second  simulation,  all  distribution  models  except  f  and  f  were 
changed  to  lognormal  to  test  the  sensitivity  of  the  results  to  the  assumed  distribution 
models.  The  results  were  C  =  1-344,  fij.  =  0-399,  and  A-  =  0.153-  It  is  seen  that 
the  assumed  distributions  of  x,  y,  f,  x,  y,  and  f  do  have  an  influence  on  C,  6^., 
and  A-,  but  that  it  is  small.  In  general,  this  influence  will  be  small  regardless  of 
the  distributions,  provided  the  second-order  term  in  Equation  2-3a  is  small  compared  to 
the  first-order  term. 
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SECTION  3 


CAPACITY  WILL  EXCEED  DEMAND 


3-1  INTRODUCTION. 


Consider  a  failure  mode  where  the  system's  capacity  is  C  under  the  demand  0. 
The  probability  that  C  will  exceed  D  can  be  calculated  with  1001  confidence  if  you 
know  the  distribution,  the  true  value  of  the  mean,  the  random  COV,  and  the  functional 
form  of  C  and  D,  that  is,  if  Aj:  =  Ajj  =  A^  =  A^  =  0.  For  lognormal  distribution 
of  C  and  D,  this  probability  is  precisely 


where 


P(C  >  D) 


$ 


(3-D 


p £  =  Mean  of  C 

Up  =  Mean  of  D 

6  =  COV  of  C 

«D  =  COV  of  D 

$(C)  =  Cumulative  probability  of 

(see  Table  3-1 ) 


the  standard  normal  variate  E 


However,  for  the  realistic  case  of  nonzero  A’s,  P(C  >  D)  itself  becomes  a  random 
variable,  in  the  Bayesian  sense,  with  expected  value  P  and  systematic  COV  Ap. 

In  what  follows,  we  elect  to  write  Q(P  >  P  )  for  the  probability  that  P  >  PQ,  and 
to  read  Q(P  >  P  )  as  "our  confidence  that  P  exceeds  Po." 

This  section  shows  how  to  calculate  P,  Ap,  and  Q(P  >  PQ)  for  log¬ 
normal  distribution  of  C,  D,  C,  and  6  and  for  functionally  and  statistically 
independent  C,  D,  C,  and  D.  However,  the  methodology  will  yield  reasonably 
accurate  results  for  other  unimodal  distributions  when  P,  P  ,  and  Q  are  near  0.5, 
say,  0.01  <  (P,  P  ,  Q)  <  0.99. 
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3-2 


METHODOLOGY . 


Calculate  the  expected  value  of  P(C  >  D)  using  the  following  equation: 

.  c  \(' +  6d)0  +  a!) 

n[5\(i  +  6g)  (l  +  A25)__ 

(1  +  T2)  1  n  ( 1  +  «^)(1  +  62d) 

where 

C  =  Your  best  estimate  of  up,  the  actual  mean  (average,  or 

expected)  value  of  C  (see  Eqs.  2-2a  and  2-3a) 

D  =  Your  best  estimate  of  pp,  the  actual  mean  (average,  or 

expected)  value  of  D 


Ac 

*  COV  that 
mean  of 

reflects 
C  (see 

how  we  1 1 
Eq.  2-5) 

C 

represents 

PC  * 

the 

actual 

ad 

=  COV  that 
mean  of 

reflects 

D 

how  we  1 1 

5 

represents 

PD> 

the 

actua 1 

$(E)  =  Cumulative  probability  of  the  standard  normal  variate  ? 

(see  Table  3-1) 

6.  =  COV  that  reflects  your  best  estimate  of  the  random  nature 

of  C  (see  Eq.  2-ia) 

<$_  =  COV  that  reflects  your  best  estimate  of  the  random  nature 

of  D 


Note  that  the  ratio  C/D  is,  to  the  first  order,  the  mean  factor  of  safety.  For 
2  2  2  2 

small  COVs  (i.e.,  6^.  <<  1,  6^  <<  1,  A^  <<  1,  and  A^  <<  1),  Equation  3“2  reduces 
to 


The  derivation  of  Equations  3-2  and  3-5  is  given  in  Appendix  A. 
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where 


Equation  3*2a  is  displayed  in  Figure  3*1. 

The  median  value  of  P(C  >  0)  is 


Use  Figure  3*2,  or  the  following  approximate  expressions,  to  determine 
the  systematic  COV  of  P(C  >  0) : 


=  T2  I*  m  1  +  T2  \ 

2irP2  (1  +  t2)  eXP  \  P  '  !  +  I  T2  ) 


for  T  <  0.7 


-  (°- 


25  *  1  cot  V1  +  2T  Up(1  *  P) 


I1.327T 


*0.2155 


for  T  >  0.7 


Unfortunately,  a  closed-form  expression  for  Ap  could  not  be  derived.  The  deri 
vation  of  Equations  3*6  and  3*7  is  given  in  Appendix  B.  It  should  be  noted  that 
Equation  3*7  is  partially  empirical. 


Use  the  following  equation  to  calculate  your  confidence  that 

P(C  >  D)  >  P  :  * 
o 


(3-8) 


(3-8a) 


Equation  3”8a  is  plotted  in  Figure  3-3  for  an  illustrative  value  of  P  and  for 
various  T.  Note  that  Equation  3-8  plots  as  a  straight  line  in  normal -normal 
probability  space. 

The  following  alternative  form  of  Equation  3-2  is  better  suited  for 
calculating  the  required  mean  factor  of  safety  of  a  failure  mode: 


C 

D 


(3-9) 


For  small  COVs,  Equation  3~9  reduces  to 


C 

D 


exp 


kP 


V(' +  j2)K 


(3-9a) 


3-3  ILLUSTRATIVE  USE. 

Calculate  the  probability  that  capacity  will  exceed  demand,  where 


C 

1.28  6d  = 

0.21 

6 

0.55  Ac-  = 

0. 16 

«C  = 

0.39  a-d  = 

0.24 

Subst i tut i on 

yields,  upon 

of  the  lower 

rearranging 

one-sided  Q-confidence  limit  for  into  Equation  3"1 

terms,  Equation  3~8. 
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Plotting  these  three  points  in  norma t -normal  probability  space  yields  the 
solid  line  shown  in  Figure  3'4.  The  open  and  filled  circles  are  the  data  points  that 
result  from  a  reworking  of  this  same  problem  by  Monte  Carlo  simulation,  as  will  be  dis¬ 
cussed  in  the  next  subsection. 

3-4  VALIDATION. 

In  order  to  validate  the  methodology  presented  in  Section  3-2,  Monte  Carlo 
simulation  was  used  to  rework  the  illustrative  problem  (see  Sec.  2-4).  An  outer  loop  of 
1000  and  an  inner  loop  of  855  were  used. 

In  our  first  simulation,  all  distribution  models  (C,  D,  C,  D)  were  assumed  to 
be  lognormal,  like  our  methodology.  The  results  were  P  =  0.938  and  Ap  =  0.0883.  Our 
methodology,  which  yielded  P  =  0.935  and  Ap  =  0.0877,  is  in  excellent  agreement.  Some 
of  the  percentiles  for  the  Q  function  for  this  simulation  are  indicated  in  Figure  3-4 
by  the  filled  ci rcles. 

In  our  second  simulation,  all  distribution  models  were  assumed  to  be  normal 
to  test  the  sensitivity  of  the  results  to  the  assumed  distribution  models.  The  results 
were  P  =  0.900  and  Ap  =  0.0932.  These  results  were  indicated  by  the  open  circles 
plotted  in  Figure  3_4.  For  most  applications,  the  disparity  shown  in  Figure  3-4  for  Q 
greater  than  about  0.1  would  be  acceptable. 
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o 


Figure  Illustrative  problem. 
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SECTION  4 


CAPACITY  WILL  EXCEED  REPEATED  DEMANDS 


4-1  INTRODUCTION. 

This  section  extends  the  results  presented  in  Section  3  to  the  case  of 
repeated  application  of  demand.  Capacity  or  demand  or  both  may  change  randomly  or 
deterministically  from  demand  application  to  demand  application.  The  set  of  demands 
may  be  deterministic,  perfectly  dependent,  statistically  independent,  or  partially 
dependent.  All  the  demands  of  a  deterministic  set  are  known.  None  of  the  demands  are 
known  in  an  independent  set.  Given  one  demand,  the  other  demands  in  a  perfectly  depen¬ 
dent  set  become  deterministic.  These  same  remarks  apply  to  the  set  of  capacities. 


The  probability  that  the  system's  capacity  in  a  given  failure  mode  will  exceed 

repeated  demands  is  shown  in  Table  4-1  for  each  of  these  states  of  dependency  (after 

2 

Ref.  4).  For  states  where  P  is  bounded  and  5.  is  either  large  (demands  are,  in 

effect,  deterministic)  or  small  (capacities  are,  in  effect,  deterministic)  compared  to 
2 

5  ,  the  appropriate  deterministic  case  is  approximately  correct.  Figure  4-1  shows 

un  2  2 

the  error  introduced  when  6  is  neither  large  nor  small  compared  to  <5_  .  Notice 

un  Ln 

that  if  the  demand  set  has  a  common  density  distribution  (i.e.,  a  common  mean  and  COV) 

and  the  capacity  set  has  a  common  density  distribution,  the  entries  in  Table  4-1  simplify 

to 


P  =  Ppl  =  P1  (4-1) 

N  n 

P  =  II  Pn  =  P^  (4-2) 

n=  1 

p"  <  P  -  P,  (4-3) 


Since  P^  is  a  random  variable,  in  the  Bayesian  sense  (see  Sec.  3),  the 
resultant  probability  P  is  also  a  random  variable.  How  to  calculate  P  is  shown 
below. 
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Calculate  Q (P  >  P  )  using  Equation  3-8,  where  T  is  obtained  by  entering 
Figure  3”2  with  P  and  Ap.  Note  that  for  P  ?  P^ ,  ,  Q(P  >  P  )  is  approximate  and 
T  has  no  physical  meaning. 

A- 3  ILLUSTRATIVE  USE. 

Calculate  the  probability  (P  vs.  Q)  that  the  system's  capacity  in  a  given 
failure  mode  will  exceed  four  applications  of  demand.  Assume  C^  ,  Cj >  and  are 

statistically  independent,  but  have  a  common  distribution  function.  Assume  the  same 
independence  and  commonality  for  the  demands  and  the  expected  demands.  However,  assume 
that  the  expected  capacities  are  perfectly  dependent.  Assume 


c 

1.28 

o> 

O 

II 

0.21 

D  = 

0.55 

> 

Ol 

II 

0.16 

6c  = 

0.39 

ad  - 

0.24 

From  Table  4-1,  we  know  that 


p  -  n  p„  -  p,p2p3pt 


From  Section  3“3,  we  know  that 


P,  =  P2  =  P3  =  P,,  =  0.935 


A  =  A  -  A  =  A  =  0.0855 

P1  2  p3  P4 


Note:  these  are  the  same  parameters  used  in  Section  3~3- 
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Substituting  into  Equations  A-6  and  A- 7  yields 


P  =  0.935**  =  0.76A 

Ap  =  A  x  0.08772  +  12  x  p-  p  x  0.08772 

n  m 

The  correlation  coefficient  p“  “  is  calculated  using  Equation  4-7  with  Pn  ^  =  ® 

*rvm  num 

and  p:  :  =1.0.  Equation  4-7  yields  p-  -  =0*311  and  Ap  becomes  0.244,  upon 

tntm  r  r  • 

.  "  P1  ,  n  m 

substitution  for  p-  -  . 

n  m 

Entering  Figure  3-2  with  Ap  =  0.2AA  and  P  =  O.76A  yields  T  =  0.7-  Enter 
ing  Equation  3-8  with  T  =  0.7  and  P  =  O.76A  gives 


0.88  - 

kP  \ 

0  1 

0.7 

/ 

P 

0 

Q 

0.5 

0.90 

0.81 

0.5 

The  straight  line  shown  in  Figure  A-2  was  constructed  from  the  above  data. 


A-A  VALIDATION. 

In  order  to  validate  the  methodology  presented  in  Section  A,  Monte  Carlo 
simulation  was  used  to  rework  the  illustrative  problem.  An  outer  loop  of  139  and  an 
inner  loop  of  855  was  used.  All  distributions  were  assumed  to  be  lognormal.  The 
results  were  P  =  0.783  and  Ap  =  0.202.  Some  of  the  percentiles  for  the  Q  function 
are  shown  in  Figure  A-2  as  the  filled  circles.  The  agreement  between  the  two  solutions 
is  reasonably  good. 


(a)  Statistically  independent  capacities 
and  perfectly  dependent  demands 

Figure  4-1.  Probability  that  capacity  will  exceed  repeated 
demands:  One  failure  mode. 


AA9312 


FAILURE-MODE  SETS 


This  section  extends  the  results  presented  in  Section  3  to  a  set  of  failure 
modes.  Only  one  application  of  demand  per  failure  mode  is  considered.  Capacity  or 
demand  or  both  may  change  randomly  or  deterministically  from  failure  mode  to  failure 
mode.  The  set  of  capacities  may  be  deterministic,  perfectly  dependent,  statistically 
independent,  or  partially  dependent.  All  the  capacities  of  a  deterministic  set  are 
known.  None  of  the  capacities  of  an  independent  set  are  known.  Given  one  capacity,  the 
other  capacities  in  a  perfectly  dependent  set  become  deterministic.  The  same  remarks 
apply  to  the  set  of  demands. 

The  probability  that  all  the  capacities  in  an  M-fai 1 ure-mode  set  will  exceed 
their  demands  is  shown  in  Table  5-1  for  each  of  these  states  of  dependency  (after  Ref.  A). 
Noting  the  similarity  between  Tables  4-1  and  5-1,  we  conclude  that  the  methodology  pre¬ 
sented  in  Section  4  for  a  system  responding  in  a  given  failure  mode  to  N  repeated 
demands  is,  with  a  simple  change  of  notation,  also  applicable  for  an  M-fai lure-mode  set. 


SECTION  6 


K 


ASSESSMENT 


6-1  INTRODUCTION. 

You  will  be  faced  either  with  assessing  (synthes iz i ng)  the  probability  of 
mission  success  of  an  existing  system  or  with  allocating  the  probability  of  mission 
success  to  the  failure  modes  of  an  evolving  system.  The  former  task,  which  is  by 
far  the  easier  of  the  two,  is  addressed  here.  The  task  of  allocating  the  probability 
of  mission  success  is  addressed  in  Section  7. 

6-2  METHODOLOGY. 

follow  these  eight  steps  to  assess  the  probability  of  mission  success  of  an 
existing  or  defined  system: 

1.  Develop  demand  scenarios.  Complete  Steps  2  through  7  for  each 
scenario. 

2.  Identify  the  system's  failure  modes. 

3.  Calculate  the  system's  demand  applied  in  each  failure  mode. 

k.  Calculate  the  system's  capacity  in  each  failure  mode. 

5.  Calculate  the  probability  of  no  failure  of  the  system  in  each  failure 

mode . 

6.  Construct  the  series-parallel  network  of  no-failure  probabilities. 

7.  Calculate  PMS  vs.  Q. 

8.  Draw  PMS  vs.  Q  envelope. 

What  each  of  these  eight  steps  entails  is  outlined  below. 

6-2.1  Step  1:  Develop  Demand  Scenarios. 

Exercise  demand  options  (if  any)  to  develop  demand  scenarios.  Complete 
Steps  2  through  7  for  each  scenario. 
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6-2.2 


Step  2:  Identify  Failure  Modes. 

Identify  all  the  failure  modes  of  the  system  that  can  abort  the  mission. 

This  task  will  be  made  easier  if  the  system  failure  modes  are  categorized  and  each 
category  is  addressed  in  turn. 

6-2.3  Step  3:  Calculate  Demand. 

Using  the  methodology  presented  in  Section  2,  calculate  the  mean,  random  COV, 
and  systematic  COV  of  the  demand  that  is  applied  to  the  system  in  each  failure  mode 
identified  in  Step  2.  If  the  system  is  subject  to  repeated  demand  application,  calcu¬ 
late  the  demand  descriptors  for  each  application. 

6-2. k  Step  k:  Calculate  Capacity. 

Using  the  methodology  presented  in  Section  2,  calculate  the  mean,  random  COV, 
and  systematic  COV  of  the  capacity  of  the  system  in  each  identified  failure  mode.  If 
the  system  is  subject  to  repeated  demand  application  and  the  capacity  change1'  from 
demand  to  demand,  calculate  the  capacity  descriptors  for  each  demand. 

6-2.5  Step  5:  Calculate  Probability  of  No  Failure. 

Using  the  methodology  presented  in  Sections  3  and  4,  calculate  the  expected 
probability  of  no  failure  of  the  system  and  its  associated  systematic  COV  in  each 
identified  failure  mode.  Account  for  repeated  demand  applications,  as  required. 

6-2.6  Step  6:  Construct  System  Network. 

Construct  the  series-parallel  network  of  the  system  failure  mode  probabili¬ 
ties.  (Note  that  the  expected  vilues  and  systematic  COVs  of  these  probabilities  were 
calculated  in  Step  5-)  Do  this  by  grouping  the  failure  modes  into  sets  such  that 
within  each  set  it  can  be  reasonably  assumed  that  there  is  perfect  dependency;  between 
sets,  it  can  be  reasonably  assumed  that  there  is  statistical  independence.  Accomplish 
this  step  under  the  assumption  that  there  is  zero  systematic  uncertainty  throughout  the 
system. 
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6-2.2 


Step  2:  Identify  Failure  Modes. 

Identify  all  the  failure  modes  of  the  system  that  can  abort  the  mission. 

This  task  will  be  made  easier  if  the  system  failure  modes  are  categorized  and  each 
category  is  addressed  in  turn. 

6-2.3  Step  3:  Calculate  Demand. 

Using  the  methodology  presented  in  Section  2,  calculate  the  mean,  random  COV, 
and  systematic  COV  of  the  demand  that  is  applied  to  the  system  in  each  failure  mode 
identified  in  Step  2.  If  the  system  is  subject  to  repeated  demand  application,  calcu¬ 
late  the  demand  descriptors  for  each  application. 

6-2.4  Step  4:  Calculate  Capacity. 

Using  the  methodology  presented  In  Section  2,  calculate  the  mean,  random  COV, 
and  systematic  COV  of  the  capacity  of  the  system  in  each  identified  failure  mode.  If 
the  system  is  subject  to  repeated  demand  application  and  the  capacity  changes  from 
demand  to  demand,  calculate  the  capacity  descriptors  for  each  demand. 

6-2.5  Step  5:  Calculate  Probability  of  No  Failure. 

Using  the  methodology  presented  in  Sections  3  and  4,  calculate  the  expected 
probability  of  no  failure  of  the  system  and  its  associated  systematic  COV  in  each 
identified  failure  mode.  Account  for  repeated  demand  applications,  as  required. 

6-2.6  Step  6:  Construct  System  Network. 

Construct  the  series-parallel  network  of  the  system  failure  mode  probabili¬ 
ties.  (Note  that  the  expected  values  and  systematic  COVs  of  these  probabilities  were 
calculated  in  Step  5.)  Do  this  bv  grouping  the  failure  modes  into  sets  such  that 
within  each  set  it  can  be  reasonably  assumed  that  there  is  perfect  dependency;  between 
sets,  it  can  be  reasonably  assumed  that  there  is  statistical  independence.  Accomplish 
this  step  under  the  assumption  that  there  is  zero  systematic  uncertainty  throughout  the 
system. 
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6-2.7 


Step  7:  Calculate  PMS. 


The  system's  probability  of  mission  success  (PMS)  is  calculated  in  a 
manner  similar  to  the  calculation  of  capacity  or  demand  (see  Sec.  2).  Accordingly, 
the  actual  PMS  is  represented  by 

PMS  =  g  (P 1  ....  ,Pj  ....  ,Pj)  (6-D 


where  P.  is  the  actual  probability  of  no  failure  of  the  system  in  the  jth^  set  of 
failure  mode  probabilities  identified  in  Step  6.  The  first-order  approximation  of  the 
expected  value  of  PMS  is  simply 


PMS  =  g(P1,...,P.,...,PJ) 


(6-2) 


where  P.  is  the  expected  probability  of  P  calculated  in  Step  5  and  the  function  g 
is  the  mathematical  equivalent  of  the  series-parallel  arrangement  of  P] ,  P2>  P^,... 
constructed  in  Step  5-  Calculate  PMS"  using  the  well-known  rules  for  manipulating 
series-parallel  arrangements  of  independent  probability  events. 

Calculate  the  systematic  COV  of  PMS  (i.e.,  the  COV  of  PMS)  using 


£  £ 


i=i  j=i 

'*j 


PMS2  9P; 


*19—  a  —  -  A  A 

a5  PP.P.  P.  P. 
JPj  i  J  i  J 


(6-3) 


where  the  partial  derivatives  are  to  be  evaluated  at  Pj,  P2>  Pj»-.-’»  Ap  is  the 

systematic  COV  of  P.  calculated  in  Step  5;  A-  is  the  systematic  COV  associated  with 
J  9 , 

the  modeling  error  in  your  network;  and  Pp.p  is  the  correlation  coefficient  for  P. 

•  i  j  1 

and  P..  Calculate  pp  p  using  Equation  4-8. 

J  •  j 

Finally,  calculate  your  confidence  that  PMS  exceeds  PMSq  using 


Q(PMS  -  PMS  ) 


(6-4) 


Add  the  second-order  terms  as  required. 
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_____  J* 

Obtain  T  by  entering  Figure  3~2  with  PMS  in  place  of  P,  and  Ap^<.  in  place  of  A  . 
Note  that  Equation  S-k  plots  as  a  straight  line  in  normal-normal  probability  space. 


6-2.8  Step  8:  Draw  PMS  Envelope. 

Using  the  results  of  Step  7,  plot  the  PMSq  vs.  Q  line  for  each  demand 
scenario  on  lognormal-lognormal  probability  paper.  The  left-most  envelope  of  these 
lines  is  the  sought-after  probability  of  mission  success  vs.  confidence  relationship 
for  the  particular  mission  under  consideration  (see  Fig.  6-1). 


6-3  ILLUSTRATIVE  USE  . 

The  seventh  step  of  the  above  methodology  is  illustrated  below  for  the  system 
network  shown  in  Figure  6-2  and  for 


P,  =  0.99 

P2  =  P3  =  0.9 

PA  =  0. 95 

Ap  =  0. Ok 


P  p 

2  3 

Ad  =  0.02 


A- 

q 


=  0.02 


P  P 

2  3 


p  P„P„ 


3  2 

A1 1  other  ,i  ^  0.0 


1.0 


T  has  no  physical  meaning  for  systems  comprising  two  or  more 


independent  failure  modes. 
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Calculate  PMS  using  Equation  6-1: 


pms  =  p3p4  +  p,p2p4  -  p,p2p3p4 


Calculate  PMS  using  Equation  6-2: 


pms  =  p3pa+  p,p2p4  -  p,p2p3p4 


=  0.3k 


Calculate  the  partial  derivatives  in  Equation  6- 


3PMS 


3P, 


3PMS 


3P, 


3PMS 

3P, 


3PMS 


3P.. 


=  P.P,  -  P2P3P4  =  0.0855 


■  V*  •  Wt  ■  0-09'" 


"  “  0'1036 


‘  P3  *  V2  -  Wj  ‘  °'9891 


Substituting  the  above  partials  into  Equation  6-3  yields 

4,5  -  °'022  *  (or)2  °-08552  -  om2  *  (or)2  °'09'"2 
*  (orf  0  10362  *  °-'2  *  (off  °-989'2  x  °-02 


+  2  0°91  x  0'9'V  °-0941  x  °-1036  x  °-1  x  °-1 


=  0.03V 
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Determine  T  by  entering  Figure  3“2  with  PMS  =  0.94  and  =  0.034: 

PMS 

T  =  0.28 


Finally,  use  Equation  6-1*  to  obtain  the  solid  line  plotted  in  Figure  6-2. 


6-1*  VALIDATION. 

In  order  to  validate  the  methodology  presented  in  Section  6-2,  the  illustrative 
problem  presented  in  Section  6-3  was  reworked  using  binomial  models  as  a  basis  for  simu¬ 
lation.  This  simulation  technique  is  explained  below. 

If  P.  denotes  the  population  mean  and  Ap  denotes  the  coefficient  of 

variation  of  an  estimate  (mean)  from  a  sample  of  size  N.  from  the  ith^  population,  then 


0  -  P.)  /  P | N .  - 

I 

Thus,  from  the  problem  input  (Sec.  6-3),  we  infer 

N j  =  6.31  =  6 

n2  =  11.11  =  11 

n3  =  11.11=11 

=  131.58  =  132 

For  each  set  of  possible  sample  outcomes  (S^,  S2>  S^,  S^) ,  where  S.  denotes  the  number 
of  successes  in  N.  trials,  the  system  reliability  estimate  will  be  given  by 


PUS  = 


P3P4  +  P1P2P4  “  P1P2P3P4 


P.  =  S.  /  N. 

i  i  i 
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where 


The  probability  of  this  PHS  value  is  given  by 


Note  that  the  i  =  3  term  is  ignored  in  the  cell  probability,  since  p-  -  =  1.0 

(i.e.,  S2=S3).  23 

This  binomial  model  yields  PHS  =  0.932  and  =  0.0348.  (Our  method¬ 
ology  yielded  PMS  =  0.94  and  =  0.034.)  Some  of  the  percentiles  for  the  Q 

function  for  this  model  are  indicated  in  Figure  6-2  by  the  filled  circles.  Although 
the  Q  curve  for  the  binomial  model  is  not  linear,  the  agreement  with  the  presented 
methodology  is  reasonably  good. 

The  general  remarks  about  the  applicable  domain  made  in  Sections  2-4  and  3~4 
also  apply  here. 
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SECTION  7 


ALLOCATION 


7-1  INTRODUCTION. 

The  reverse  of  assessment  of  the  probability  of  mission  success  (PMS)  of  an 
existing  system  is  the  allocation  of  the  PMS  to  the  failure  modes  of  an  evolving  system. 
Although,  in  concept,  allocation  is  the  reverse  of  assessment,  the  methodologies  by 
which  each  is  achieved  are  quite  similar,  as  will  be  seen  in  this  section. 

7-2  METHODOLOGY. 

Follow  these  11  steps  to  allocate  the  probability  of  mission  success  (PMS): 

1.  Develop  demand  scenarios.  Complete  Steps  2  through  9  for  each  scenario. 

2.  Identify  the  system  failure  modes. 

3.  Calculate  the  system's  demand  applied  in  each  failure  mode. 

A.  Construct  the  series-parallel  network  of  no-failure  probabilities. 

5.  Select  a  trial  value  of  PMS. 

6.  Allocate  PMS  to  each  failure  mode. 

7.  Calculate  for  each  failure  mode  the  mean  capacity  required  to  satisfy 
the  allocated  share  of  the  PMS. 

8.  Calculate  ApMS,  the  systematic  uncertainty  of  PMS. 

9.  Calculate  PMS.  Repeat  Steps  5  through  9  until  the  final  and  calculated 
PMS's  are  acceptably  close. 

10.  Identify  the  critical  mean  capacity  in  each  failure  mode. 

11.  Write,  for  each  failure  mode,  the  deterministic  design  specification  for 
the  identified  critical  mean  capacity. 

Steps  1,  2,  3,  and  A  are  identical  to  the  first  four  steps  of  assessment  (see  Sec.  6). 
Steps  8  and  10  have  their  counterparts  in  assessment  and  need  not  be  discussed.  Steps  5 
6,  7,  9.  and  11,  however,  are  unique  to  allocation.  Step  11  requires  no  explanation. 
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7-2.1  Step  5. 

Select  a  trial  value  of  the  expected  probability  of  mission  success,  PMS. 
Solving  Equation  6-4  for  PMS  and  finding  its  maximum  and  minimum  values  with  respect  to 
T  yield  these  bounds: 


where  the  probability  that  the  system  will  successfully  complete  the  mission  is  at 

least  PMS  ,  stated  with  Q  confidence.  Use  Equation  7“1,  with  criteria  PMS  and  0. 
o  o 

as  an  aid  in  selecting  a  trial  value  of  PMS. 

7-2.2  Step  6. 

The  crux  of  Step  6  is  to  allocate  the  PMS  in  such  a  way  that  maximum  cost 
effectiveness  is  achieved  for  the  system.  In  general,  this  optimum  state  will  be 
achieved  by  allocating  the  largest  shares  of  the  PMS  to  those  failure  modes  that  exhibit 
the  smallest  cost  increments  per  share  of  the  PMS ,  and  vice  versa.  See  Reference  5 
for  an  introduction  to  optimizing  allocations. 

7-2.3  Step  7. 

Calculate  for  each  failure  mode  the  mean  capacity  required  to  satisfy  the 
allocated  share  of  the  PMS.  Use  Equation  3"9- 

7-2.4  Step  9- 

Calculate  PMS  using  the  following  manipulated  form  of  Equation  6-4: 


where  T  is  obtained  by  entering  Figure  3-2  with  the  trial  value  of  PMS  and  the 
VmS  ca’cu’ated  'n  Step  3,  and  PMSq  and  Q  are  given  criteria  values.  Repeat  Steps  5 
through  9  until  the  trial  and  calculated  PMS's  are  acceptably  close. 
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7-3 


ILLUSTRATIVE  USE. 


The  following  example  illustrates  Steps  5,  6,  7,  and  9.  Validation  of  this 
example  is  not  necessary. 

Step  1 . 

Only  one  demand  scenario  is  assumed  applicable  for  purposes  of  this  illustra 
tive  example. 

Step  2. 

Only  two  failure  modes  are  assumed  significant. 

Step  3- 

Assume  that  we  have  determined  the  following  demands  for  Failure  Modes  1 

and  2 : 

D1  =  28  units  [>2  =  13  units 


0.18 

=  0.20 

0.15 

A-  =0.06 

Step  . 

The  two  failure  modes  are  assumed  to  be  in  series. 
Step  5. 

Assumed  cri teri a 

PMS  =0.5 
o 

Q  =  0.9 

Therefore,  from  Equation  7"1,  we  obtain 
0.5  <  PMS  <  0.9 


Try  PMS  =0.7 


Assume,  for  purposes  of  this  illustrative  example,  that 


Cost  <*  Cj  +  C2, 


where  Cj  and  C 2  are  the  expected  capacities  of  the  system  in  Failure  Modes  1  and  2, 
respectively.  Moreover,  assume  that  we  have  determined  that 


0.09 

6r  =  0.18 
L2 

0.15 

Az  =  0.12 

Equation  3"3a  yields  =  1.0  and  T =  0.5.  Equation  3"9a  yields 


C,  =  28  exp (0 .29  k-  ) 


C  =  13  exp(0. 30  k-  ) 

z  2 


Thus , 

Cost  28  exp(0.29  k-  )  +  1 3  exp(0.30  k-  ) 
1  z 


For  PMS  =  P2  =  0.7,  it  can  be  verified  that  cost  is  approximately  minimized  for 
Pj  =>  0.78  and  P2  =  0.90.  Thus,  C^  =  35  units  and  C2  =  19  units. 


Step  8. 

Entering  Figure  3"2  with  T^  =  1  and  P^  =  0.78  yields  Ap  =  0.27.  In  a 

similar  fashion  we  find  Ap  =  0.094.  From  Equation  6-3,  ^ 

2 

A^  =  Ap  +  Ap  =  0.272  +  0.0942  =  0.2862 
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Entering  Figure  3-2  with  &pM$  =  0.286  and  PMS  =  0.7  yields  T  -  0.7- 
Finally,  Equation  1~2  yields 


0.7x0+  1.282 

Vi  +  0.7 2 


0.85  *  0.7 


Step  5a- 

Try  PMS-  =  0.85. 

Steps  6a  and  7a. 

For  PMS  =  0.85,  Pj  =  0.90  and  P2  =  0.94  approximately  minimize  cost 
Thus,  Cj  =  41  units  and  C2  =  21  units. 

Step  8a. 

Entering  Figure  3-2  with  T=1  and  P  =  0.90  yields  ^-0.155.  In 

similar  fashion  we  find  A  =  0.064.  From  Equation  6-3, 

2 


A^ms  =  0.1552  +  0.0642  =  0.1682 

Step  9a. 

Entering  Figure  3-2  with  ApM$=  0.168  and  PMS  =0.85  yields  T-0.7 
Equation  7-2  yields  PMS  =  0.85  (trial  and  calculated  PMS  identical). 

Step  10. 

=  41  units 

C2  =  21  Units 
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SECTION  8 


CLOSING  REMARKS 


The  applicable  domain  of  the  methodology  is  summarized  as  follows.  The 
calculation  of  C,  6^,  and  A-  will  be  relatively  accurate  and  insensitive  to  the  dis¬ 
tribution  details  of  the  independent  variables  of  C  if  the  second-order  term  in  the 
expression  for  C  (Eq.  2~3a)  is  small  compared  to  the  first-order  term.  (The  same 
remark  applies  to  D,  6^,  and  A-.)  The  calculation  of  P(C  >  D)  will  be  relatively 

accurate,  provided  C,  C,  0,  and  5  are  unimodal  in  distribution  and  P  and  0  are 

near  0.5,  say  0.01  <  (P,  Q)  <  0.99.  C,  C,  0,  and  6  will  exhibit  unimodal  distribu¬ 
tions  if  their  independent  variables  exhibit  unimodal  distributions  or  if  there  are  many 
independent  variables.  The  calculation  of  Q(PMS  >  PMSq)  will  be  relatively  accurate, 
provided  the  second-order  term  of  PMS  is  small  and  PMS  and  0  are  near  0.5,  say 
0.01  <  PMS,  Q  '  0.99. 

We  have  elected  to  write  Q.(P  >  Pq)  for  the  probability  that  P  >  Pq,  and  to 

read  Q(P  >  PQ)  as  "Our  confidence  that  P  exceeds  Pq."  The  use  of  confidence  in 

this  context  has  as  its  precedent  the  statement  of  the  one-sided  confidence  limit  for 

the  estimate  of  a  model  parameter  in  classical  statistics.  Thus,  strictly  speaking, 

Q(P  >  P  )  should  be  read  "The  lower  cne-sided  Q-confidence  limit  for  P  is  P  . "  " 

o  ° 

Our  methodology  (or  for  that  matter  any  methodology  of  the  same  purpose) 
requires  that  the  systematic  COVs  be  quantified  using  subjective  reasoning.1  If  the 
sponsor  of  the  application  of  the  methodology  will  not  accept  subjective  estimates,  then 
there  can  be  no  application.  Most  sponsors,  however,  will  entertain  the  idea  of  subjec¬ 
tive  estimates  if  the  bases  for  these  estimates  are  well  documented. 

Finally,  it  should  be  remarked  that  admitting  even  less  general  definitions 
of  the  terms  "system"  and  "mission"  than  are  normally  held  (or  discarding  the  concepts  of 
"system"  and  "mission"  altogether)  gives  the  presented  methodology,  or  §t  least  portions 
of  the  methodology,  quite  general  applicability.  For  example,  the  methodology  could  be 
applied  to  cost  estimating,  to  scheduling,  and  to  RDT6E  planning. 


These  remarks  are  also  applicable  for  Q(PMS  ■>  PMSo) . 

In  the  rare  cases  where  specific  experiments  have  been  performed,  systematic  COVs  can 
be  calculated. 
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APPENDIX  A 


If  we  transform  y  to  the  variate 


x  =  N (0,  1) 
by  the  transformation 

x  =  (y  -  m)/S 
the  rei iabi I i ty  becomes 
<t>(Tx  +  A) . 


=  f  <t>(Tx  +  A)  f(x)  dx 

OO 

=  f  f(Tx  +  A)  f(x)  dx 
•'  —  00 

=  (2n)”'  P  exp(-  |(Tx  +  A)2  +  xZ!/2)  dx. 

J  —  09 


Transform 
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Where  K  denotes  an  arbitrary  constant  of  integration.  Since  R  =  0.5  when 
A  =  0,  we  have 


0.5  =  ■MO)  +  K 
K  =  0.  QED. 


Suppose  now  that  capacities  and  demands  are  lognormally  distributed,  not 

JL 

normally  distributed.  Let 

2 

z  =  log  (capacity)  =  N(p,  o  ) 

2  2 

THEOREM  A-2:  The  nth  moment  of  capacity  is  exp(np  +  n  a  /2) 

Proof:  Let  x  =  N(0,  l),  and  let  E [g ]  denote  the  expected  value  of  g. 

m  E[Cn]  2  E[ezn]  =  E [exp ( (xo  +  m)  n)] 

n 

=  (2n)  °  f  exp((xo  +  u)  n)  exp(-x2/2)  dx 


Let 


Then 


y  =  x  -  on 


=  (2")  O'"*  exp(-y2/2  +  o2n2/2  +  pn)  dy 


2  2 

=  exp(np  +  n  a  /2) 


Corollary:  E [C )  =  exp(p  +  o  /2). 


At  this  point  we  should  note  that  the  preferred  procedure  is  to  transform  all 
observations  by  z  =  log  C  and  work  with  the  transformed  sample,  if  this  sample 
passes  a  goodness-of-fi t  test  for  normality.  The  remainder  of  this  Appendix  would 
then  be  unnecessary. 
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Corollary:  If  &  is  the  coefficient  of  variation  of  C,  then 


Note  that 

Corol lary : 


Coro  I lary: 


Corol lary 


,2  _  2 


21/2 


6  =  m„/m,  =  m„  -  m,  m 


2/1  12  1  |  /  1 


1/ 


2 

=  |exp(2p  +  2o2)  -  jexp(p  +  o2/2)|  j\exp(\i  +  o2/2)\ 


o2  =  log(1  +  62) 


62  =  o2  +  a^/2  +  a^/6,  small  a.  Also  6^  -  a**  +  o^,  6^ 


The  third  central  moment  is 


3  3 

-  3m2m^  +  3m^  -  m^ 

=  exp(3y  +  3o2/2) jexp(3c2)  -  3  exp(o2)  +  2j 
=  for  small  o. 

The  fourth  central  moment  is 


=  m 


Let  C 

n 

£[C„) 


2  4  4 

^  -  Am^  + 

3o  +  19o^| ,  for  small  0. 

denote  the  mean  of  a  sample  of  size 
2 

=  exp(p  +o/2) 


n. 


SM 


'i  ».♦»  '  i*  , 


Since 


log(1  +  w)  =  w  -  w2/2  +  w3/3  -  w**A  +  w3/5  -  w^/6 

E[log(Cn)]  =  p  +  a2/2  -  n62/2n2  +  nOo**  +  4o^)/3n3 

-n  (30**  +  ]3a^)/kr\^  -  3n(n  -  IJfi^An** 

+  lOn  (n  -  1)  (3oV)/5n5  -15n(n  -  1 )  (n  -  2)66/6n6 
Ignoring  terms  of  order  c^/n^  ,  a^,  or  less.  Then 

E  [  log  (C^)  1  =  u  +  a2(n  -  1)/2n  -  a\lAn  -  1/n2  +  3An3  +  3/4n2  -  3An3) 

+  o6(-1/12n  +  V3n2  -  19An3  -  3An2  +  3An3 
+  6/n3  -  5/2n3)  •  QED 


THEOREM  A-5:  If 

yc  =  log  |cnVl  +  A2/Vl  +  62  } 

then 

E[H(-]  -  u  +  a^(n  -  l)/3n3 

Proof: 

\  'og  {(1  +  «2/n)/(l  +  62)|  =  log  |l  +  52/njn  -  j  log(l  +  62) 

=  2n  log  I1  +  62  +  ("  -  1)  6i*/2n  +  (n  -  1 )  (n  -  2)56/6n2|  -  a2/2 
=  277  ,Q9 {t 1  +  <52]  [  1  +  (n  -  l)64/2n  +  (n  -  1 )  (n  -  2)66/6n2  -  (n  -  l)f6/2n]| 


56 


a2/2n  +  2“  [  (n  -  iMa**  +  a^)/2n  +  o^(n2  -  3n  +  2  -  3n2  +  3n)/6n2]  -  a2/2 


-  a2 ( n  -  l)/2n  +  ( n  -  1 ) / 4n 2  +  o^[n2  -  3n  +  2]/12n^ 


and  the  theorem  follows  from  A-l*.  QED 


From  Theorem  A-5,  M_  is  an  asymptotically  unbiased  estimate  of  p  .  We 

U  1/ 

could  then  proceed  in  the  same  way  with  the  demands.  The  result  would  be  that 
MC  ”  wou^  an  asymptotical  }y  unbiased  estimate  of  p^,  -  p^.  The  median 
reliability  would  then  be 


(k  *  Mo)/l 


2  x 

°C  +  °D 


which  is  Equation  3*5-  Equation  3-2  follows  from  this  and  Theorem  A-l. 


APPENDIX  B 


DERIVATION  OF  EQUATIONS  3-6  AND  3‘7 

What  is  the  variance  of  the  reliability,  given  the  same  notation  as  in 
Appendix  A?  From  that  discussion,  we  have 

R  =  <t>(Tx  +  A) 


where 


x  =  N (0,  1). 


The  variance  is 


o 


2 

R 


/  (Tx  +  A)  f  (x)  dx  -  R2 


Let 


R  5  <KA), 


2 

the  median  reliability.  We  have  two  approximations  for  a^,  one  for  values  T  <  0.3 
and  the  other  for  T  >  0.3-  These  are  tabulated  for  different  values  of  R  and  T 
and  compared  with  the  values  from  numerical  integration  (see  Table  B-1).  The  first 
approximation  was  uncovered  as  follows:  Let 


/*  00 

M2(T)  =  J  /(Tx  +  A)  f (x)  dx. 


Then 


(T) 

M^'(T) 


2x,I’{Tx  +  A)  f(Tx  +  A)  f(x)  dx 

2x2f(x)  dx  [  f2  (Tx  +  A)  +  4>(Tx  +  A)  f'(Tx  +  A)j 
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i-tilZhul.-a  hf.CS.  bi-u*-N0T  FI 


M‘"(T)  =  f  2x3f (x)  dx[3ff'  + 

2  j  .QO 

M""(T)  =  f  2x**f  (x)  dx[3f'2  +  4ff"  + 

2  J  -  M 

S  i  rice 

f'(x)  =  -xf(x) 

f"(x)  =  (x2  -  1)  f(x) 

f'"(x)  =  (-x3  +  3x)  f(x) 

we  have 

m2(o)  =  *2(a) 

M£(0)  =  0 

M 2 ( 0 )  =  2f  (A)  [ f  (A)  -  A* (A)] 

M£(0)  =  0 

M'»'(0)  =  6f(A)  [3A2f  (A)  +  4  (A2  -  1)  f(A)  +  (-A3  +  3A)  ^(A)] 

Expansion  around  T  =  0  then  gives 

M2(T)  £  <t2(A)  +  T2f  (A)  [f  (A)  -  A<i>(A)  j 

+  T4f  (A)  jf  (A)  J  7A2  -  4}  +  4>(A)[-A3  + 
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Simi larly: 


R(T) 
R'  (T) 


R"(T) 


R"'(T) 


R"“(T) 


$ (Tx  +  A)  f (x)  dx 
xf(Tx  +  A)  f(x)  dx 

x2f' (Tx  +  A)  f (x)  dx 

x3f"(Tx  +  A)  f (x)  dx 

xV'(Tx  +  A)  f (x)  dx 


R(0)  =  <t(A) 

R'(0)  =  0 

R"  (0)  =  -Af  (A) 

R"'(0)  =  0 

R""(0)  =  3Af  (A)  [3  -  A2] 


R(T)  =  *(A)  -  T2Af(A)/2  +  Af  (A)  [3  -  A2]/8 

r2(t)  « 


4>2  (A)  -  TZAf  (A)'t'(A)  +  T^Af  (A)  [Af  (A)  +  <t(A){3 


o2  =  M2(T)  -  R2(T)  =  T2f2(A)  +  T4f2(A)[7A2  -  k  -  A2]/4 

=  f2(A)  T2 (1  +  T2(3A2/2  -  1)) 


=  f2  (A  / Vi  +  3T2/2)  /  (1  +  T2) 


and  our  first  approximation  is 


oR  =  f (fit fyf]  +  3T2/2)  t/VT  +  T2 ,  sma 11  T. 


For  our  second  approximation,  we  notice  that  (see  Table  B-1) 


a2  =  a2  4ft(1  -  R) 


j-Q. 21 Pb/ 0.7535 


,  large  T. 


All  we  need,  therefore,  is  a 


THEOREM  B-1: 


o2  =  0.25  -  (1/ff)  cot"1 Vi  +  2T2 
R  A=0 


Proof: 


3M  (T)/9A  =  2f  41  (Tx  +  A)  f(Tx  +  A)  f(x)  dx 

—  co 


^  °o 

=  ( 1  /tt)  I  4>(Tx  +  A)  exp(-j[Tx  +  A]2  +  x  \/l)  dx 

—  CO 


If  we  make  the  substitution 


+  T2  +  At/Vi  +  T2 


we  have 


3M2(T)/3A 


=  (1/ti)  j  O^Ty jW+  T2  +  A/ ( 1  +  T2)j 

exp(-{y2  +  A2/(1  +  T2)}/2 )  dy/l 

=  2f (A1 )  £  $(T'y  +  A")  f (y )  dy/VT+  T2 


where 


A'  =  A  /  V  1  +  T 


T'  =  T/Vl  +  T 


A"  =  A'  /  V)  +  T 


Then  the  algebra  of  Theorem  A-l  gives 


Now  let 


3M2(T)/3A  =  2f(A')^A"/Vl  +  T'2"j/Vl"  +  T2 

3M2(T)/3A'  =  2f  (A1  )  4>|a'  /Vi  +"  2T2) 

M2(T)  =  2  f(w)*(w/V7  +  2T2  )  dw 

r  H  1  /Vl  +  2T2 

rA' 

M2(r)  =  2  I  f(w)<t(rw)  dw 

•'••or* 
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low ,  i  f 


<3M2(r)/3r  =  2  J  wf(w)  f(rw)  dw 

=  ( 1  / tt )  J"  exp|-|r2  +  ij'w 2/2j  wdw 

=  -exp|-A'2(r2  +  1)/2j^7i(r2  +  1) 

=  -exp|-A2r2j^iT(r2  +  1 )" 

A  =  0,  then  R  =  0.5  and 

M2(r)  =  0.5  -  f  dr/71  (r2  +1)  =  0.5  -  (1/ti)  tan  1  (r) 

•'o 

o2  =  0.25  -  (1/ti)  tan  ^(r)  •  QED 


4 


From  this,  we  could  get  an  approximation  for  extremely  large  T  (small 
M2(r)  =  0.5  -  r/n  +  r3(A2  +  0/3* 

2 


0.5  -  r/ Ti  +  r3(A2  +  1  )/3h  -  R2. 
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